$ sudo apt-get update
$ sudo apt-get install octave-mpi 

octave-mpi is installed in your system.

Make ensure the octave-mpi package were installed using the commands given below,

$ sudo dpkg-query -l | grep octave-mpi *

You will get with octave-mpi package name, version, architecture and description in a table

octave-mpi package basic information: